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1.  OVERVIEW 


The  TLARTS  System  is  used  <in  bt^ard  aircraft  carriers  to  obtain  and  distribute  television  camera  video 
images  of  vaiious  aircraft-related  operations,  including  launch.  recovei7.  and  flight  deck  operations. 
WhUe  other  cameras  are  u.sed  to  monitor  operations  on  the  flight  deck,  this  report  is  concerned  mainly 
with  the  perfonnance  requirements  of  the  center-line  cameras,  which  are  mounted  below  the  deck  and 
image  a  fixed  field  of  view  directed  along  the  nominal  glide  path  for  aircraft  on  landing  approach.  The 
center  line  cameras  provide  infomiation  on  aircraft  types  and  sizes,  and  on  their  positions  relative  to 
the  angle-deck  centerline  and  the  glide  slope.  They  must  operate  both  during  daytime  and  at  night. 
At  night,  it  is  especially  important  that  they  provide  the  be.st  possible  images  to  the  Landing  Signal 
Officer,  and  to  various  other  command  and  technical  centers. 

The  centerline  cameras  are  also  u.sed,  especially  at  night,  as  aids  in  verifying  status  of  landing  gear, 
hook  and  hanging  ordnance.  For  this  reason,  low-light-level  performance  is  critical  in  judging  the 
efficacy  of  the  cameras,  and  will  be  the  starting  point  for  the  following  analyses  and  proposals. 

This  proposal  considers  the  advantages  of  CCD  .sensor  technology  for  the  centerline  camera 
application.  Requirements  are  analyzed  and  di.scu.s.sed  for  the  sensor,  the  optics,  and  the  electronics 
elements  of  the  overall  system,  and  a  specific  proposal  is  made  for  a  .system  which  should  offer 
excellent  performance,  technical  simplicity,  and  low  cost. 

n.  THE  PROBLEM 

In  the  ILARTS  application,  it  is  important  to  see  with  reasonable  fidelity  the  understructure  of  an 
approaching  aircraft,  which  is  illuminated  only  by  weak  ambient  .sources  (moon  or  stai-  light),  or  by 
glare  or  reflected  light  coming  fi-om  the  carrier  or  from  .scattering  in  the  atmosphere  around  the  canier 
or  the  aircraft.  An  analysis  and  complete  characterization  of  actual  illumination  levels  would  be 
extremely  difficult,  given  their  great  variability.  It  is  .sufficient  to  .say  that  it  is  desired  that  the 
centerline  cameras  provide  usable  images  down  to  as  low  a  light  level  as  possible. 

Systems  designed  for  high  sensitivity  in  low-light-level  (LLL)  imaging  often  have  difficulty  in  imaging 
high-inteasity  point  .sources  which  may  be  present  in  an  otherwise  low-intensity  field  of  view  (FOV). 
During  night-time  operatioas,  the  under  caniage  and  other  weakly-illuminated  features  of  the  image 
of  an  approaching  aircraft  may  be  hidden  by  the  relatively  bright  light  coming  from  its  own  navigation 
or  approach  lights.  As  tlie  aircraft  gets  closer  and  closer,  the  integrated  flux  level  contributed  by 
these  lights  may  increase  to  very  high  levels,  while  the  illumination  levels  of  the  structures  which  must 
be  viewed  remains  constant.  The  flux  fi-om  the  point  sources  may  be  diffused  or  spread  in  the  image 
plane  by  atmospheric  scattering,  by  undesired  reflection,  scattering,  or  diffraction  within  the  optics, 
or  by  optical  or  electronic  spreading  within  the  image  detector.  The  result  may  be  that  the  light  from 
a  point  source  spreads  over  a  large  portion  of  the  entire  image  area,  ob,scuring  the  image  system’s 
view  of  the  structural  detail. 
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Critical  Challenges 


Sensitivity  is  often  quoted  as  the  decisive  performance  parameter  for  a  LLL  sensor.  However,  it  is 
accepted  in  the  field  that  other  measures  are  more  u.seful.  For  example,  the  output  signal  level,  and 
hence  the  .sensitivity,  of  any  system  may  be  increa.sed  by  changing  the  gain  of  .some  final  amplifier 
stage.  However,  if  the  front  end  of  the  system  is  photon-limited,  .so  that  ^he  detected  image  consists 
of  only  a  modest  number  of  single-photoelectron  events,  no  amount  of  increase  in  gain  or  output 
sensitivity  can  improve  the  information  content  ot  the  image  —  all  that  results  is  a  brighter  .scintillation 
pattern,  and  not  an  increase  in  the  ability  to  perceive  the  underlying  structure  in  the  imaee. 

Generally,  human  perception  ot  .structure  in  a  visual  field  has  been  shown  to  require  a  minimum  peak 
signal-to-rms  noi.se  ratio  of  approximately  5: 1  at  each  di.scemable  point  in  the  image.  Thus,  signal 
to  noise  ratio  (SNR)  as  a  function  ot  illumination  level  is  usually  a  better  measure  of  system 
peifoiTnance  than  is  sensitivity. 

As  will  be  argued  below,  the  SNR  of  candidate  systems  for  the  pre.sent  LLL  application  depends 
above  all  on  the  optical  entrance  aperture  area  and  transfer  efficiency  (i.e.,  on  the  number  of  photons 
captured  per  second  from  a  given  .source)  and  the  detector  quantum  efficiency  (i.e.,  the  number  of 
signal  photoelectrons  created  per  captured  photon).  The  product  of  the.se  two  basic  pai'ameters 
determines  the  number  of  signal  electrons  per  pixel  in  any  given  situation.  Shot  noi.se,  which  is  equal 
to  the  square  root  of  the  number  of  signal  electrons,  then  sets  a  fundamental  limit  on  the  SNR  ratio 
which  the  system  can  then  achieve.  The  tir.st.challenge  is  to  acquire  the  signal  at  each  pixel  with 
maximum  SNR.  Qnlv  then  can  one  hope  to  display  the  maximum  amount  of  information.  (Signal 
processing  and  display  challenges  will  be  di.scu.s.sed  below.) 

Given  the  problem  of  bright  lights  in  the  FOV,  and  that  of  widely  varying  general  illumination  levels, 
the  ideal  detector  for  the  centerline  camera  .system  must  not  only  achieve  near  quantum-limited  SNR 
at  low  light  levels,  but  must  do  so  over  a  wide  range  of  intensities.  The  FOV  may  have  a  very  low 
general  level  of  illumination  on  a  moonle.s.s  night,  or  any  higher  level  up  to  full  sunlight  conditions. 
Within  a  FOV  containing  generally  low  illumination  levels,  the  image  of  a  weakly-illuniinated  aircraft 
undercarriage  may  be  superposed  on  the  “skirts”  of  the  signal  produced  by  a  bright  point  source. 
These  requirements  imply  that  the  ideal  system  must  have  an  exti'emely  wide  dynamic  range,  and  that 
this  wide  dynamic  range  must  be  achieved  not  solely  through  slow  system  adju.stments,  such  as 
changing  acceleration  voltages  or  iris  settings,  but  must  be  available  instantaneously,  on  an  intra¬ 
scene  basis. 

With  bright  lights  in  an  otherwise  dimly-illuminated  FOV,  image-spreading  problems  may  be 
produced  by  both  the  optics  and  the  detector.  Multiple  reflections  within  the  optics  may  produce 
ghost  images.  Scattering  from  aperture-defining  edges,  or  by  inhomogeneities  within  the  glass  or  the 
anti-reflection  coatings  of  the  glass  elements,  may  cause  a  point  image  to  spread  significantly.  Even 
within  the  detector,  light  may  scatter  and  be  detected  at  locations  remote  from  the  position  of  the 
image  of  a  point  source.  In  addition,  photoelectrons  or  secondary  charges  produced  by  the  detection 
of  the  incident  photons  may  spread  in  space.  All  these  effects  must  be  considered  in  addressing  the 
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centerline  camera  design  problem.  Careful  lens  design  (for  example,  minimi/ing  the  number  of  i>lass- 
air  interfaces  in  the  optical  ti’ain  and  providing  for  effective  anti-reflection  coating  over  the  entire 
range  of  wavelengths  to  which  the  detector  is  sensitive)  is  necessaiy.  and  the  choice^of  detector  may 
be  influenced  by  internal  optical  considerations. 

A  final  fundamental  consideration  for  the  centerline  camera  system  follows  from  the  observation  that 
the  mo.st  important  u.se  of  the  information  which  it  generates  involves  real-time  visual  observation  of 
the  image  as  presented  on  a  television  monitor.  Due  to  its  own  dynamic  range  limitations,  and  to  the 
perceptual  characteristics  of  human  sight,  no  TV  monitor  can  hope  to  present  all  the  infomiation 
contained  in  even  a  moderately  wide  dynamic  range  image.  In  standard  television  image  processing, 
it  is  standard  to  use  non-linear  processing  to  improve  the  perceived  image  at  the  monitor.  (For 
example,  the  voltage  signal  pre.sented  to  the  monitor  may  be  made  proportional  to  the  sqiuu'e  root 
of  the  sensor  signal  level,  rather  than  to  its  value  directly.)  More  innovative  signal  processing  is 
clearly  desirable  in  the  present  application,  where  there  may  be  wide  variations  in  the  levels  and 
ranges  of  intensities  present  in  a  given  image,  and  even  an  independent  variation  in  the  parts  of  the 
overall  range  of  intensities  which  convey  the  most  important  structural  infoimation. 

ni.  PERFORMANCE  AND  LIMITATIONS  OF  PRESENT  SYSTEM  - 
GENERAL  DISCUSSION 

The  centerline  cameras  presently  used  in  the  ILARTS  .system  use  silicon  intensifier  tube  (SIT) 
technology.  These  vacuum  tube  detectors,  also  known  as  silicon  electron  bombardment  induced- 
response  (SEBIR.or  SiEBlR)  tubes,  provide  front-end  gain  through  a  high-voltage  acceleration  of 
the  photoelecti-ons  followed  by  the  generation  of  multiple  electron-hole  pairs  in  a  silicon  solid-state 
diode  target  by  each  photoelectron.  This  gain,  together  with  the  low  noi.se  of  the  amplification  stage 
inherent  in  the  vacuum  gain  process,  provides  high  sensitivity  and  near  single-photon  detection 
capability.  However,  the  semitran.sparent  cathode  technology  u.sed  in  the.se  vacuum  imagers  limits 
the  peak  quantum  efficiency  (QE)  to  -20%,  which  in"  turn  limits  the  number  of  detected 
photoelectrons,  and  hence  the  signal-to-nolse  ratio,  at  any  given  level  of  illumination.  Further,  in 
compai'ison  with  the  high-QE  silicon  CCD  detector  technology  which  will  be  proposed  below,  the 
SIT  tube’s  photocathode  is  insensitive  at  neai-lR  wavelengths  in  the  range  of  650  to  850  nanometers, 
and  thus  suffers  a  further  penalty  in  effective  QE. 

There  are  other  limitations  inherent  in  the  SIT  technology  which  are  important  to  the  centerline 
camera  operation.  The  detector  can  be  damaged  by  high  intensity  levels  at  either  the  photocathode 
or  the  silicon  target  structure.  As  a  result,  the  SIT  tube  depends  on  reducing  the  acceleration  voltage 
and  stopping  down  the  external  iris  whenever  there  is  either  a  bright  smalF object  in  the  FOV  or  the 
general  illumination  increases  beyond  specified  levels.  Two  undesiiable  effects  follow  -  (1)  the 
detector  reduces  its  gain  when  an  unusually  bright  spot  appears  in  the  FOV,  and  no  longer  offers  high 
sensitivity  for  viewing  dimly-illuminated  structure  at  other  locations  in  the  FOV  and,  (2)  at  any 
illumination  level,  no  matter  how  high,  the  high  photoelectron  gain,  modest  QE,  and  iris-limited 
photon  rate  combine  to  give  an  objectionable  level  of  quantum  noise  in  the  image. 
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The  SIT  tube  is  also  inherently  subject  to  internal  optical  problems.  Figure  I  shows  the  internal 
structure  of  a  typical  SIT  tube.  Achieving  reasonable  QE  with  the  semitransparent  cathode  requires 
that  a  substantial  percentage  (typically  50%)  of  the  incident  flux  pass  thought  the  cathode  plane  into 
the  image  compartment.  This  light  may  .scatter  back  to  the  photocathode  and  produce  a  diffuse 
general  background  signal  which  drastically  increases  the  background  noi.se  and  limits  the  dynamic- 
range  for  regions  ouLside  the  image  of  a  bright  point  source. 

IV.  PERFORMANCE  AND  LIMITATIONS  OF  PRESENT  SYSTEM  - 
LABORATORY  OBSERVATIONS 

A  laboratory  system  was  set  up  to  simulate  the  optical  conditions  appropriate  to  the  centerline  camera 
operation.  Using  green  LED’s,  a  bar  pattern  was  illuminated  at  levels  approximating  that  of  an 
airplane’s  undercarriage  under  full  moon  night-time  conditions,  or  below.  Small  LED^s  were  also 
set  up  to  .simulate  the  navigation  lights  on  an  aiiplane’s  rudder  and  wingtips,  and  could  be  powered 
at  levels  to  simulate  the  centerline  camera’s  illumination  for  aiiplane  ranges  from  2  kilometers  down 
to  approximately  20  meters.  Other  LED’s  were  used  to  create  an  extended  source  which  could 
produce  an  intensity  at  the  camera  location  comparable  to  that  of  various  bright  objects.  Finally,  an 
extremely  bright  incandescent  fiber-optic  .source  was  used  to  simulate  the  inten.se  illumination  which 
the  centerline  camera  might  experience  if  other  landing  or  taxi  lights  were  turned  on  while  the  aircraft 
was  in  the  camera’s  FOV. 

Laboratory  observations  confirmed  that  the  present  ILARTS  SIT-tube  based  system  shows  the  gain 
reduction,  .scattered  illumination,  and  image-spreading  problems  described  above,  and  that  it  has  a 
relatively  .small  intra-scene  dynamic  range.  Undesirable  gain  reduction  (and  iris  stopdown)  occuired 
at  intensities  clearly  of  interest  in  field  situations.  Images  of  bright  point  .sources  spread  over  larae 
portions  of  the  monitor  display,  and  could  easily  hide  the  information  content  of  an  otherwi.se  clear 
image  of  the  weakly-illuminated  bar  chart. 

For  comparison,  .several  CCD  camera  systems  were  set  up  to  view  the  same  laboratoiy  scene  as  the 
Srr-tube  .system.  All  the  cameras  were  fitted  with  lenses  which  gave  similar  fields  of  view,  and  used 
the  same  f/number,  as  the  SIT  camera. 

Signal-processing  electronics  for  the  camera  signals  were  modified  to  allow  up  to  fiO-fold  increase 
in  gain,  and  sufficient  DC  offset  that  an  o.scilloscope  or  TV  monitor  display  could  be  used  to  look  for 
image  detail  structure  over  an  extremely  wide  range  of  optical  intensities.  Using  these  electronics, 
it  was  confirmed  that  the  SIT  system  had  a  limited  dynamic  range  and  a  relatively  low  SNR  at  high 
levels  of  illumination.  Further,  it  was  demonstrated  that  the  signal  from  the  CCD  cameras,  which 
would  be  expected  to  have  a  much  greater  dynamic  range,  contained  much  more  information  than 
could  be  displayed  on  the  monitor  at  any  one  setting  of  the  controls.  (See  the  discussions  below  on 
non-linear  signal  processing  opportunities.) 

CCD  cameras  used  in  the  laboratory  testing  included  a  new  Panasonic  1/3"  format  camera,  which  we 
understood  was  being  used  for  some  field  tests  relative  to  ILARTS.  This  industi-ial-grade  camera 
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uses  a  relatively  small  CCD  chip  and  hence  required  a  short  focal  length,  therefore  small  acceptance 
aperture,  lens.  Also,  an  older  RCA  CCD  camera  was  tested,  which  u.sed  a  modestly  larger  CCD. 
With  the  longer  focal  length  lens  required  to  give  the  same  FOV.  the  RCA  camera  should  have  been 
significantly  more  .sensitive  that  the  Panasonic.  Unfortunately,  differing  electronic  gains  and  noi.se 
levels  in  the  two  cameras  prevented  confirming  the  expected  differences  in  SNR. 

The  Pana.sonic  CCD  image  sensor  was  the  standard  front-illuminated  inteiiine-Uansfer  variety. 
Images  of  bright  point  sources  with  this  camera  .showed  considerably  more  spreading  and 
objectionable  radial  artifacts  than  were  found  in  images  acquired  with  the  RCA  sensor,  which  was 
aframe-tran.sferCCD  device.  These  ob.servations  reinforced  the  initial  presumption  that  the  optimum 
choice  for  the  centerline  camera  application  is  a  frame-transfer,  back-illuminated  CCD. 

A  detailed  investigation  was  made  to  deteirnine  the  cau.ses  of  the  spreading  evident  in  images  of  a 
small,  extremely  bright,  .source  in  the  FOV.  This  spreading,  which  could  completely  obscure  a  weak 
background  image  in  the  SIT  system,  was  pre.sent  to  a  much  lesser  extent  in  the  setups  using  cameras 
with  CCD  seasors.  An  experiment  was  conducted  to  determine  whether  the  image  spreading  in  the 
RCA  back-illuminated  CCD  camera  was  cau.sed  by  the  .sensor,  or  by  the  camera  lens. 

Figure  2  shows  the  relative  signal  level  as  a  function  of  position  in  the  “wing.s”  of  the  CCD  image  of 
an  extremely  bright  .source,  over  more  than  5  orders  of  magnitude.  The  solid  circles  show  the  signal 
as  a  function  of  position  along  the  CCD  scan  line  passing  through  the  center  of  the  image.  To 
deteiTTiine  if  this  spreading  was  cau.sed  by  the  image  sensor  or  by  the  optics,  a  scan  was  made  across 
the  same  image  plane  with  a  simple  silicon  photodiode  detector  preceded  by  a  small  aperture.  The 
open  circles  and  .squares  in  Figure  2  show  the  excellent  agreement  between  this  data  and  that  from 
the  CCD.  (The  peak  broadening  for  the  photodiode  data  is  due  to  the  size  of  the  aperture.)  Tliis 
agreement  demon.strates  that,  even  with  the  low-flare  commercial  lens  u.sed  in  this  test,  image 
spreading  is  due  primarily,  if  not  entirely,  to  the  optics  rather  than  the  CCD  detector.  Although  the 
CCD  system  alieady  behaves  better  than  the  SIT  tube  in  terns  of  image  spreading,  it  was  concluded 
that  optics  designed  for  lowest  po.ssible  flare  can  provide  a  significant  further  reduction  in  image 
spreading  (“flare”)  problems  in  the  centerline  camera  application. 

V.  IMPROVED  CENTERLINE  CAMERA  SYSTEM  -  DISCUSSION 

As  indicated  in  the  preceding  discu.s.sions,  there  are  several  ftindamental  areas  in  which  improvements 
are  required  relative  to  the  performance  of  the  present  SIT-tube  based  centerline  camera  technology. 
Any  new  camera  system  design  must  consider  the  following  items,  from  the  beginning: 

Acceptance  Aperture  Area 

Detector  Quantum  Efficiency 

Detector  Spectral  Response 

Detector  and  Readout  Noise  Characteristics 

Optical  Transfer  Efficiency 

Optical  and  Electronic  Image  Spreading 
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Signal  Prcx-essing  Techniques 


No  “magic  solution”  exists  in  anv  one,  or  even  in  anv  two,  of  these  independent  areas.  They  all  need 
to  be  considered  in  the  design  effort. 


The  present  STT-tube  system’s  performance  is  considerably  poorer  than  that  of  the  previously  used, 
but  no  longer  available,  Isocon  vacuum  tube  imaging  technology.  The  physical  reasons  for  this  were 
explored  fully  in  the  Phase  I SBIR  Propo.sal.  Without  repeating  the  arguments  of  the  Proposal,  it  can 
be  said  that  there  Is  no  area  of  detector  peifonnance  in  which  the  SIT  tube  is  preferable  to  the  Isocon 
for  the  present  application.  All  of  the  advantages,  and  all  of  the  disadvantages,  of  the  .semitransparent 
cathode,  vacuum  tube,  physics,  are  pre.sent  in  both  devices.  Further,  the  intra.scene  dynamic  ransie 
of  the  SIT  tube  is  extremely  limited. 

In  addition  to  the  fact  that  theoretical  arguments  show  that  the  Isocon  tube  peifoi-mance  exceeds  that 
of  the  SIT  tube,  there  is  practical  experience  showing  that  Isocon  .sy.stem  performance  was  not  only 
better,  but  in  general  was  adequate  to  the  Navy  centerline  camera  (or  Landing  Signal  Officer’s)  needs. 
Given  this,  the  analysis  presented  in  the  following  sections  compares  the  performance  of  the 
recommended  CCD-based  technology  with  that  of  Isocon’s  rather  than  SIT  tubes. 

As  a  starting  point,  it  may  be  observed  that  the  peak  QE  of  a  CCD  detector  can  be  more  than  four 
times  higher  than  that  of  the  SIT  or  Isocon  tubes,  which  employ  .semitransparent  photocathodes. 
(Typical  figures  might  be  80%  or  greater  compared  to  a  maximum  of  20%  for  S-20  photocathodes.) 
Further,  the  broader  spectral  respoase  of  the  CCD  allows  an  even  greater  advantage  for  most  natural 
sources  of  illumination. 


Relative  to  the  S-20  photocathode  spectral  response  of  the  Isocon  (and  SIT)  tubes  used  previously, 
the  solar  spectrum  is  relatively  rich  in  the  red  end  of  the  visible  region,  and  also  in  the  near  IR.  Tlie 
vacuum  seasors  thus  miss  a  lai-ge  Ifaction  of  the  photons  which  are  detectable  by  CCD  image  sensors. 
Figure  3  shows  the  two  spectral  responses,  while  Figure  4  indicates  the  relative  spectral  contents  of 
moonlight  and  of  sunlight.  In  broad  terms,  ten  times  as  many  photoelectrons  are  generated  in  a  CCD 
illuminated  by  the  solai-  (or  moonlight)  spectrum  as  by  an  S-2()  photocathode.  On  a  moonless  night, 
the  even  richer  long  wavelength  spectral  content  of  the  night  sky,  makes  the  spectrum-generated  QE 
advantage  of  the  CCD  even  greater  -  approximately  fifty-fold. 

Because  of  their  electron  multiplication  gain  processes,  the  Isocon  and  SIT  vacuum  tube  technologies 
offer  extremely  low  noise  amplification  at  the  lowest  light  levels.  Noise  floors  can  be  1  photoelecrton 
per  pixel  at  normal  temperatures  and  readout  rates.  Although  the  use  of  on-chip  amplification  at  the 
output  of  a  CCD  sensor  photoarray  allows  for  minimal  capacitance,  and  hence  much  lower  noise 
floors  than  would  be  possible  with  off-chip  preamplification.  CCD  readout  noise  floors  are  in  the 
range  of  20  to  40  photoelectrons  at  broadcast  video  bandwidths. 

It  is  important  to  stress  that  the  noise  advantage  of  the  vacuum  tube  sensors  disappears  above  very 
].QW  illumination  levels.  This  is  because  of  the  lower  effective  QE,  which  results  in  a  significantly 
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lower  number  of  photoelectrons  generated  per  pixel  during  an  exposure  time.  The  shot  noise  in  the 
signal,  which  is  equal  to  the  square  root  of  the  number  of  photoelectrons,  must  be  added  quadratically 
to  the  readout  noi.se,  and  give  a  clear  advantage  to  CCD  detectors  at  all  but  the  lowest  integrated 
intensity  levels.  As..will  be  slio.wn  below,  a  properly-designed  CCD  detected-  sv.stem  will  pp'rform 
bstter  .than  the  Tsocon  or  SIT-tube  based  systems  at  any  intensity  which  is  adequate  to  give,  n  visnnHy 
useful  image. 

Given  the  assumed  use  of  a  CCD  detector  in  a  future  ILARTS  centerline  camera  system,  the  fii>>t 
major  consideration  is  sensor  area.  For  a  given  FOV  and  focal  ratio,  the  acceptance  aperture  of  an 
optical  system  is  proportional  to  the  image  sensor  ai'ea.  This  is  because  the  FOV  and  chip  si/e 
determine  the  focal  length.  A  larger  chip  implies  a  longer  focal  length  and.  at  fixed  focal  ratio,  a 
larger  acceptance  aperture.  For  the  centerline  camera,  a  balanced  design  must  make  effective  u.se  of 
the  available  aperture  in  the  flight  deck,  with  fiiither  increases  in  chip  si/e  balanced  off  against  sensor 
technology  and  cost  considerations. 

It  is  clear  that  improved  optics  can  significantly  reduce  ghost  images,  flare,  and  stray  light  problems 
compared  to  the  present  system.  Properly-chosen  CCD  technology  can  essentially  eliminate  any 
problem  with  image  spreading  in  the  focal  plane. 

With  optimal  CCD  and  optics  designs,  a  new  system  can  offer  not  only  excellent  sensitivity,  but  also 
an  extremely  wide  intrascene  dynamic  range.  In  order  to  make  u.se  of  the  information  available  from 
the  sensor,  new  and  innovative  processing  techniques  must  be  developed  and  applied  to  the  signal 
before  sending  the  final  image  to  the  LSO’s  monitor. 

The  following  subsections  will  discuss  detector,  optics,  and  signal  proce.ssing  requirements  in  more 
detail. 

V-a.  Detector 

As  the  preceding  paragraphs  have  stressed,  il_is  absolutely  critical  in  .striving  for  low  light  level 
Cgcfoimance  not  to  use  a  sensor  who.se  area  is  smaller  than  the  optimum,  .since  a  .smaller  chip  leads 
to  a  smaller  acceptance  aperture,  fewer  photons  and  photoelectrons,  and  thus  a  lower  signal-to-noise 
ratio  in  the  detected  image. 

■The  next  consideration  in  choosing  a  CCD  is  quantum  efficiency  and  spectral  respnnsp.  Themo.st 
common  CCD  technology  involves  front  illumination  and  interline  transfer.  Front  illumination  refers 
to  the  fact  that  light  enters  the  photosensitive  pixel  volume  through  the  face  of  the  silicon  wafer  on 
which  all  of  the  photolithographically-produced  layers  were  created.  The  result  is  a  chip  that  is 
inexpensive  to  manufacture,  but  that  has  undesirably  low  QE.  This  is  caused  by  blockage  and 
absorption  of  radiation  in  the  structures  overlying  the  photosites  in  the  silicon  chip.  Interline  transfer 
implies  that  the  charge  packets  are  read  out  along  CCD  “bucket  brigade”  storage  registers  which  lie 
between  each  line  of  photosites.  This  also  has  negative  implications  for  sensitivity. 
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The  preferred  type  of  CCD  chips  for  low  light  level  applications  are  thinned,  back-illuminated  devices. 
In  this  technology,  the  electronic  .stiiictures  are  processed  from  one  side  of  the  silicon  substrate,  in 
whatever  complexity  is  desired.  After  processing  is  es.sentially  complete,  the  processed  side  of  the 
silicon  substrate  is  mounted  on  a  backing  plate,  and  the  original  .silicon  substrate  thickness  at  the 
opposite  face  is  etched  away.  The  resulting  sensor  is  extremely  thin  and.  when  illuminated  from  the 
thinned  side,  can  have  neaily  100%  effective  photosensitive  area.  It  also  captures  many  more 
photoelectrons  fi'om  a  given  illumination  source,  due  to  lowered  absorption  in  the  reduced-thickness 
surface  layer.  Peak  QE’s  of  the.se  devices  can  be  as  high  as  90%,  compared  to  30  or  40%  for  a 
typical  front-illuminated  device. 

Back  illumination  and  high  QE  and  fill  factor  also  require  that  the  image  information  not  be  read  out 
on  an  interline  basis.  Rather,  the  entire  frame  fiom  an  exposure  is  shifted  during  the  vertical  blankinu 
period  to  a  two-dimensional  CCD  storage  register  located  on  the  chip  abutting  the  image  area.  (This 
is  illustrated  schematically  in  Figure  9.)  The  pixels  of  this  stored  image  are  read  out  .sequentially 
while  the  next  frame  is  being  exposed.  Since  the  image  area’s  pixels  remain  sensitive  to  light  as  a 
fi-ame  is  .shifted  into  the  storage  area,  these  “frame  transfer”  devices  must  be  shuttered  off  during  the 
vertical  shifting  Irom  A  to  B,  to  prevent  a  bright  source  in  the  FOV  from  generating  a  vertical  streak 
in  the  image  as  it  is  moved  into  the  storage  register.  This  shuttering  is  implemented  in  commercial 
cameras  using  a  rotating  di.sc  with  open  and  opaque  areas,  synchronized  with  the  vertical  blanking 
of  the  video  signal. 

Because  of  the  much-reduced  density  and  complexity  of  structures  overlying  the  .sensitive  layer  of 
back-illuminated  devices,  compared  to  the  standard  low-cost  technologies"  problems  with  back- 
scattering  or  diffi-action-induced  spreading  of  light  between  pixels  are  es.se"ntially  eliminated.  This  is 
an  important  advantage  of  the  frame  transfer  devices  in  the  centerline  camera  application. 

A  bright  point  source  of  light  in  an  otherwise  dimly-illuminated  FOV  may,  of  course,  heavily 
oversaturate  the  .stored  charge  capacity  of  an  individual  pixel.  In  the  eai  liest  CCD  devices,  this  excess 
charge  leaked  into  adjacent  pixels,  creating  a  “blooming”  of  high-intensity  regions  of  an  imase. 
Current  CCD  technology  uses  antiblooming  drains  for  excess  charge  at  each  photosite,  and  is 
generally  quite  effective  at  eliminating  blooming.  The  particular  CCD  technology  which  will  be 
discus.sed  below  is  exceptionally  effective. 

For  the  present  application,  where  the  final  output  is  to  a  television  monitor,  standard  CCD 
technologies  can  give  excellent  spatial  resolution  and  contrast,  or  modulation  transfer  functions 
(MTF),  without  any  special  requirements  which  must  be  met. 

Low  readout  noise  has  become  quite  standard  for  CCD  image  sen.sors  used  in  challenging 
applications.  RMS  figures  of  20  to  40  electrons  may  be  routinely  achieved. 

The  following  paragraphs  present  a  quantitative  analysis  of  the  performance  to  be  expected  of  a  CCD 
chip  optimized  for  the  centerline  camera  application.  In  terms  of  low  light  level  performance,  the  key 
advantage  of  the  CCD  is  its  high  QE  and  broad  spectral  respon.se. 
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Sensitivity  of  CCD  Camera  Compared  to  Image  Tsocon 


The  benchmatk  for  the  centerline  cumerji  in  terms  ot  demonstruted  ucceptuble  perfonnance  is  the 
ILARTS  cameras  made  with  Image  Tsocon  television  camera  tubes,  which  are  no  longer 
manufactured.  Therefore  it  is  appropriate  to  compare  the  anticipated  perfomance  of  a  CCD  image 
sensor  based  camera  with  this  Image  Isocon  camera  to  assess  the  efficacy  of  the  design  in  meetina 
the  ILARTS  requirements.  The  Image  Isocon  had  two  important  attributes;  { 1 )  readout  noise  that 
was  near  the  quantum  shot  noise  limit,  and  (2)  saturation  characteristics  such  that  bright  lights  in  the 
field  of  view  did  not  result  in  exce.ssive  electronic  blooming  (flare)  in  the  video  image. 

As  discu.ssed  in  other  sections  of  this  report,  the  Sarnoff  CCD  design  .selected  for  this  design  study 
has  excellent  intia.scene  dynamic  range  saturation  characteristics,  with  a  linear  dynamic  range  that 
exceeds  the  Image  Isocon  and  saturates  with  very  little  blooming .  The  key  remaining  question  then 
is:  How  does  its  low  light  level  signal  to  noi.se  ratio  compare  to  that  of  the  Image  Isocon? 

Figure  4  .shows  the  sipal  to  noise  ratio  of  the  RCA  C21093A  Image  Isocon.  This  3  inch  diameter 
tube  had  a  36  mm  diagonal  image  area.  One  notes  a  ratio  of  peak-to-peak  signal  to  RMS  noise 
current  of  20  dB  at  a  photocathode  illumination  of  3.5  x  lOE-4  lumens  per  square  foot  and  a  video 
bandwidth  of  4.2  MHz.  For  the  36  mm  diagonal  with  3x4  aspect  ratio  image  area,  the  image  area 
is  6.22  square  cm,  or  0.0067  square  foot.  Thus  the  photocathode  illumination  in  the  above  ca.se 
is  2.3  X  lOE-6  lumens.  A  lumen  is  equal  to  1.47  x  lOE-3  Watts  at  the  550  nm  peak  of  the  standard 
luminosity  curve.  This  is  also  equal  to  4. 1 1  x  10E15  photons  per  second  at  this  wavelength.  Usinsi 
these  figures  one  can  show  that  the  Image  Isocon’s  signal  to  noi.se  ratio  very  closely  matches  the 
function 


S/N  =  k  *  ( (Qe)(#photons/pixel))‘'^ 

for  values  of  quantum  efficiency,  Qe  =  0.1  and  electron  multiplier  noi.se  factor ,  “k”  =  -0.7.  This 
is  within  the  .square  root  of  2  of  shot  noise  limited  theoretical  performance,  that  can  only  be  improved 
by  increased  Qe  over  a  broader  spectral  range. 

Figure  5  shows  the  spectral  content  of  night  sky  radiation,  and  also  the  spectrum  of  moonlicht 
(which  is  essentially  the  same  as  that  of  sunlight).  Figure  3  gives  the  spectral  response  of  the  S-20 
photocathode  employed  on  the  Image  Isocon  and  the  spectral  response  of  a  state-of-the-art  back 
iUuminated  CCD  with  an  anti-reflection  coating.  The  products  of  these  spectral  responses  curves 
and  the  radiation  curves,  shown  in  Figure  6  highlight  the  suitability  of  the  silicon  back  illuminated 
CCD  detector  for  nighttime  imaging  applications,  where  the  ambient  illumination  is  rich  in  the  red 
and  near  infrared. 

The  back  illuminated  CCD  produces  -10  times  the  number  of  signal  photoelectrons  that  the  Image 
Isocon’s  S-20  photocathode  produced  under  moonlight,  which  is  spectrally  equivalent  to  sunlight. 
And  in  the  red-rich  moonless  night  sky  case  the  factor  is  -50.  This  is  the  primary  rea.son  thauhe 
proposed  CCD  can  produce  low  light  level  imaging  equal  to  or  better  than  the  Image  Isocon. 
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To  be  rigorous  about  this  comparison  of  sensitivity,  one  must  also  include  the  relative  si/e  of  the 
image  format  in  both  cases.  At  the  same  optical  focal  ratio,  the  number  of  photons  incident  on  the 
image  plane  is  proportional  to  the  area  of  the  image  plane.  Recalling  that  the  3  inch  Image  Isoct)n 
had  an  image  ai'ea  that  was  6.22  .square  cm.,  this  comparison  a,ssume.s  that  the  CCD  image  raster 
is  also  this  area.  While  CCDs  have  been  made  this  large  for  .scientific  imaging  applications,  the 
image  aiea  of  CCDs  u.sed  in  commercially  available  television  cameras  is  usually  much  smaller.  This 
is  becau.se  the  manufacturing  co.sts  of  the  CCD  and  the  camera  lenses  are  then  also  much  smaller. 
In  the  ILARTS  application  the  peifonnance  of  the  camera  is  important  to  the  safety  of  personnel 
and  aircraft,  therefore  camera  cost  tradeoffs  are  made  on  a  quite  different  basis.  We  have  assumed 
for  this  design  study  that  the  CCD  focal  plane  is  2.4  square  cm.  which  is  40%  of  the  area  of  the  3” 
Image  Lsocon.  In  this  case  the  back  illuminated  CCD  would  produce  ~4  times  the  number  of  signal 
photoelectrons  that  the  Image  lsocon  produced  under  moonlight  conditions,  at  the  same  optical  focal 
ratio  and  field  of  view.  Figure  7  compares  the  signal  to  noise  ratio  of  the  Image  lsocon  and  back 
illuminated  CCD  as  a  function  of  exposure  level  for  both  moonlight  and  night  sky  illumination 
spectral  conditions.  The  S/N  of  the  CCD  is  plotted  for  a  readout  noise  of  20. 30  and  40  electrons 
per  pixel  rms.  One  notes  that  the  back  illuminated  CCD  provides  a  significantly  higher  .S/N  for 
all  exposure  levels  where  the  S/N  is  greater  than  5.  the  threshold  where  images  become  u.senhlt^  m 
the  observer. 


V-b.  Optics  Design 


As.was  stressed  above,  the  fundamental  kev  to  achieving  the  be.st  possible  system  .SNR  nniiprtina 
and  detecting  as  many  photons  as  possible.  For  the  optics,  this  implies  that  the  acceptance  aperture 
should  cover  mo.st  of  the  area  available  in  the  window/housing  assembly  mounted  in  the  flight  deck. 
This  window  is  nominally  a  rectangle  0.9  inches  high  by  several  inches  wide.  Below  an  optical 
acceptance  diameter  of  0.9  inches,  .system  acceptance  increases  quadratically  with  diameter.  Much 
above  0.9  inches,  it  increases  only  linearly.  A  reasonable  balance  of  cost  suggests  an  acceptance 
diameter  in  the  range  of  2  inches. 

We  assume  that,  for  any  focal  length,  the  lens  which  is  required  for  the  centerline  camera  system  will 
have  a  focal  ratio  of  f/1.4.  (This  is  an  aggressive,  but  fairly  commonly  achieved,  focal  ratio  for 
camera  lens  designs.)  With  a  fixed  FQY  of  1 1  by  15  degrees,  the  optical  acceptance  aperture  is  then 
determined  by  the  detector  size. 


The  system  proposed  outlined  below  assumes  the  following  parameters: 


Field  of  View 
Detector  Size 
Focal  Length 
Focal  Ratio 


11x15  degrees 
18  X  13.5  mm 
70  mm 
£^1.4 


The  nominal  lens  acceptance  diameter  is  then  2.0  inches.  Mounting  behind  the  0.9  inch  window  gives 
an  acceptance  area  of  1 1  square  centimeters,  roughly  half  the  nominal  area. 
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For  comparison,  the  small  CCD  chip  used  in  the  Panasonic  camera  which  was  used  in  the  lab 
experiments  was  only  48  x  3.6  mm.  At  the  same  FOV,  this  implies  a  focal  length  of  19  mm,  and  an 
f/1.4  lens  of  this  focal  length  has  an  acceptance  aperture  area  of  only  1.4  .square  centimeters.  This 
reduction,  of  almo.st  a  factor  of  8  in  area,  illustrates  the  importance  of  having  a  relatively  large 
detector  for  use  in  the  optics  design. 

With  the  lens  focal  length  and  focal  ratio  fixed,  the  system  designer  needs  optimal  transmission  and 
minimal  generation  of  stray  light  from  bright  point  sources  in  the  FOV.  These  considerations  argue 
first  for  a  minimum  number  of  optical  elements  in  the  lens,  and  especially  the  minimum  number  of 
glass/air  interfaces.  Inthis  respect..flnv  system  which  u.ses  relay  lenses  in  addition  to  its  primary  lens 
is  highly  suspect. 

Partial  reflections  from  the  polished  surfaces  of  the  lens  elements  must  be  reduced  by  anti-reflection 
coatings.  In  order  to  take  advantage  of  the  IR  sensitivity  of  CCD  detectors,  these  coatings  (and  the 
lenses  themselves)  must  be  designed  to  cover  a  wider  range  of  wavelengths  than  standard  visible-light 
imaging  lenses. 

Multiple  reflections  from  the  lens  surfaces  will,  in  general,  form  “ghost”  images  somewhere  within, 
in  front  of,  or  behind  the  lens  elements.  Although  it  is  not  normally  an  important  consideration  in  lens 
design,  the  present  application  requires  that  these  images  not  be  located  neai-  the  focal  plane  of  the 
system.  This  requirement  may  usually  accommodated  in  the  lens  design  process,  as  long  as  it  is 
clearly  understood  from  the  beginning.  (In  some  cases,  tilting  the  lens  relative  to  the  line  joining  the 
centers  of  the  FOV,  the  lens,  and  the  image,  can  be  used  to  move  a  bothersome  ghost  image  outside 
the  sensitive  area  of  the  detector.) 

Finally,  there  is  the  complex  problem  of  low-level  spreading  of  the  optical  energy  from  a  bright  point 
source,  which  ideally  would  be  contained  entfrely  within  a  small  spot  in  the  image  plane.  For  the  TV 
systems  considered  here,  the  fundamental  aperture  diffraction  limit  is  not  a  concern.  More  practical 
problems,  such  as  inhomogeneities  in  optical  glasses  or  coating  layers,  or  microstnjcture  lesultinii 
from  imperfect  polishing,  may  require  higher  than  usual  standards  at  all  steps  in  lens  fabrication. 

Light  scattering  can  also  occur  within  a  complex  optical  system  whenever  the  incident  rays  strike  any 
defining  edge  in  the  lenses,  field  stops,  or  mechanical  structures.  Careful  attention  must  be  paid  to 
these  effects  throughout  the  optical  design  process.  It  is  usually  possible  to  design  a  system  in  which 
there  is  a  single  defining  field  stop.  This  stop  can  then  be  designed  for  minimum  scattering.  For 
example,  it  can  be  made  extremely  thin,  so  that  there  is  minimum  scattering  from  the  small  edge 
thickness,  by  making  it  an  evaporated  film,  rather  than  a  metal  diaphragm.  It  extreme  cases,  it  may 
even  be  useful  to  “apodize”  the  field  stop,  by  blurring  the  edge  of  the  evaporated  film  from  which  it 
is  fabricated,  in  order  to  reduce  diffraction  effects. 

The  purpose  of  the  discussions  of  the  preceding  paragraphs  is  not  to  finalize  a  lens  design,  but  simply 
to  stress  the  importance  of  a  careful  (presumably  custom)  lens  design  for  the  intended  application. 
In  summary,  optimum  system  performance  requires  that  we  con,sider  the  following  in  the  optics 
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design  process: 


Avoid  the  use  of  relay  optics 

Minimise  the.numbcr  of  optical  elements,  and  especially  of  glass/air  inteifne-es 

■Use  wide-band  VIS/IR  antireflection  coatings 

Check  and  modify  initial  lens  designs  to  control  the  positions  of  ghost  imnges 

Control  glass  Vinifonnity,  polishing  standards,  coating  materials  and  sti'ucture,  etc., 
beyond  the  level  normally  required,  in  order  to  minimize  scattering  within  the 
body  of  the  lens 

Design  the  lens  and  its  supporting  sti-uctures  to  cond-ol  the  number  and  nature 
of. all  apertures  which  intercept  the  incident  rays  which  contribute  to  the 
image,  within  or  in  the  vicinity  of  the  active  .sensor  area. 

V-c.  Signal  Processing 

While  the  intrascene  dynamic  range  required  of  the  centerline  camera  is  very  high,  and  the  range  of 
general  scene  illumination  varies  greatly  under  varying  conditions,  the  TV  monitor  on  which  the 
image  is  displayed  has  an  extremely  small  dynamic  range. 


The  CCD  camera  system  detailed  in  the  following  Section  may  offer  a  dynamic  range  greater  than 
30,000:1.  Depending  on  viewing  conditions,  a  video  monitor’s  dynamic  range  may  be  between  10: 1 
and  100:1.  As  was  confirmed  in  the  laboratory,  using  customized  electronics,  the  CCD  image  signal 
may  contain  much  more  infoitnation  than  can  be  displayed  on  the  monitor  using  standard  signal 
processing.  Innovative,  non-linear  processing  techniques  which  go  far  beyond  the  usual  automatic 
control  of  gain  and  ii'is  settings  will  greatly  enhance  the  performance  of  the  propo.sed  new  system. 

In  broad  terms,  we  believe  that  non-linear  analog  signal  compression  should  occur  early  in  the  video 
electronics  chain,  and  that  the  signal  should  then  be  digitized  for  flexible  processing.  Then,  the 
modified  digital  image  would  be  converted  back  into  an  analog  RS170  signal  for  transmission  to  the 
monitors.  (Of  course,  a  future  viewing  system  might  take  advantage  of  the  digital  video  signal,  and 
offer  improved  performance  at  the  monitor  end.) 

Analog  signal  compression  allows  quantum-limited  sensitivity  at  the  low  end  of  the  intensity  range, 
without  allowing  the  shot  noise  present  at  high  intensities  to  dominate  the  final  range  of  output  signal 
levels.  (A  square-root  processor,  for  which  the  output  of  an  amplifier  stage  is  made  proportional  to 
the  square  root  of  its  input,  produces  a  signal  in  which  equal  steps  in  voltage  correspond  to  equal 
increments  in  terms  of  rms  shot  noise.  Then  the  noise  introduced  by  digitizing  such  a  signal  can  be 
made  less  than  the  shot  noise  throughout  the  intensity  range. 

Analog  non-linear  compression  may  be  accomplished  at  video  bandpasses  using  either  “square- 
rooter”  modules  or  customized  multiple-breakpoint  diode  arrays  in  the  feedback  circuit  of  a  video 
amplifier.  After  compression,  digitizing  the  signal  to  the  level  of  perhaps  12  bits  can  be  accomplished 
at  video  pixel  rates,  and  still  represent  the  entire  range  of  input  signals.  (Without  compression. 
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digitizing  a  signal  with  a  dynamic  range  of  30,000: 1  would  require  1 6  bits,  and  would  be  difficult  to 
accomplish  at  standard  video  rates.) 

Once  the  signal  has  been  acquired  in  the  digital  domain,  there  are  many  ways  to  process  the 
information  content  to  increase  its  visibility  on  the  final  monitor.  Edges  may  be  enhanced  by  spatial 
filtering  (using  either  local  differentiation  or  *  unsharp  masking”  subtraction  of  local  averaae 
inten.sities  from  individual  pixel  values).  The  transfer  function  relating  raw  or  processed  diuitul 
images  values  to  RS170  voltages  may  be  modified  with  infinite  flexibility  simply  by  reloading  values 
in  a  1 2  bit  in/  8-bit  out  look  up  table  (LUT)  immediately  prior  to  the  conversion  back  to  analog 
voltages.  LUT  techniques  can  be  used  to  emphasize  any  desired  portion  of  the  intensity  range,  and 
coastitute  a  powerful  generalization  of  the  standard  brightnes.s/contrast  (and  “gamma,”  or  power  law 
exponent)  controls. 


The  digital  system  which  is  used  to  process  the  wide-dynamic-range  system  can,  of  course,  be 
controlled  manually.  Or  it  could  use  the  information  pre.sent  in  the  image  to  automatically  control 
its  own  parameters  (and  even  the  iris  of  the  lens).  For  example,  “histogram  processing,”  in  which  a 
histogram  of  pixel  values  is  generated  from  an  image  and  used  to  control  the  LUT  values,  could  be 
used.  In  this  way,  one  might  hope  to  use  the  available  display  dynamic  range  to  present  the  most 
important  regions  of  the  picture  with  highest  contrast.  (A  description  of  histogram  processing 
follows.  However,  while  such  processing  can  be  extremely  useful,  great  care  will  have  to  be 
exercised  in  applying  it  to  nighttime  centerline  camera  images,  where  small  areas  of  extremely  high 
intensity  and  modest  areas  of  low  intensity  must  be  viewed  against  a  field  of  generally  even  lower 
(and  uninteresting)  intensity. 

It  is  an  advantage  of  the  digital  signal  processing  concept  that  the  system  can  be  configured  with  great 
flexibility.  Manual  control  could  be  exercised  over  extremely  wide  ranges  of  parameters.  Automatic 
processing  with  a  range  of  algorithms  could  be  implemented,  tested  under  field  conditions,  and 
modified  simply  by  changes  in  the  camera  software. 


Description  of  Histogram  Processing  (from  Sarnoff  Research  Center) 

SamofF s  Imagmg  Systems  Laboratory  has  been  developing  real  time  DSP  hardware  for  digital  video 
image  processing.  Contrast  enhancement  using  adaptive  nonlinear  gray  scale  mapping  techniques 
have  been  used  to  maximize  the  information  content  in  visible  and  medium  wave  infrared  (MWIR) 
displayed  video.  Our  systems  do  not  transform  the  data  within  the  DSP  block  but  alternatively  load 
a  look  up  table  (LUT)  during  vertical  blanking  resulting  in  both  a  reduction  in  cost  and  complexity 
and  a  flexibility  to  load  non-adaptive  LUTs.  By  examining  the  incoming  video’s  gray  scale 
distribution  and  employing  techniques  such  as  Histogram  Equalization  (HE),  Histogram  Projection 
(HP)  and  Histogram  Plateau  Equalization  (PE)  the  entire  display  gray  scale  space  can  be  optimally 
exploited  for  each  incoming  frame.  Alternatively,  static  LUTs  can  be  loaded  to  invert  the  video, 
provide  gamma  transfer  functions  (H&D  curves),  contrast  stretch  using  logarithmic  mappings  or  do 
bit  plane  slicing  for  image  segmentation. 
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A  histogram  is  a  discrete  function  which  maps  a  digital  image  with  gray  levels  in  the  range  [0,  L- 1 1 
by  the  number  of  pixels  occupying  that  gray  level.  Loosely  speaking,  the  value  of  the  histogram  at 
that  gray  level  represents  the  probability  of  occurrence  at  that  brightness  and  gives  a  global 
representation  of  the  image.  By  calculating  the  Cumulative  Distribution  Function  (CDF)  which 
represents  the  probability  that  the  pixel  will  be  at  or  below  that  gray  level,  the  function,  which  ranges 
from  [0.  1],  can  be  scaled  for  any  display  dynamic  range  required  and  can  be  matched  with  any 
dynamic  range  input  device.  The  HE  routine  generates  a  complete  histogram  to  perform  the  mapping 
while  an  HP  routine  generates  a  binary  histogram  which  puts  a  one  at  any  gray  level  locations  where 
there  are  any  pixels  at  that  brightness  level  and  a  zero  where  there  are  no  pixels  at  that  briehtness. 
The  benefit  of  using  Histogram  Projection  is  when  the  contrast  of  a  small  target  on  a  uniform 
background  needs  to  be  enhanced.  The  background  distribution  and  the  small  target  distribution  are 
considered  equally  in  the  Projection  routine  while  the  Histogram  Et]ualiy.ation  routine  will  enhance 
the  contrast  in  proportion  to  the  size  of  the  object  and  enhance  the  detail  of  the  backaround  much 
more  than  the  small  target.  The  Plateau  Equalization  routine  sets  plateau  levels  that  clip  the 
histogram  strength  offering  a  compromise  between  HP  and  HE. 


VI.  IMPROVED  CENTERLINE  CAMERA  SYSTEM  -  PROPOSED  DESIGN 

In  the  following,  we  present  a  specific  proposal,  ba.sed  on  an  analysis  of  systems  requirements  in  the 
three  critical  areas  discussed  above  --  sensor,  optics,  and  signal  processing. 

The.  CCD,  sensor  proposed  tfii-fil'St  of  all,  a  custom  device,  whose  size  is  chosen  to  maximize  the  ii>;p 
of -the  available,  window  aperture.  Standard  commercial-application  CCD  chips  are  much  smaller. 
To  compromise  the  most  basic  performance  driver,  photon  rate,  on  the  altar  of  commercial 
availability  is  simply  not  reasonable,  given  the  critical  nature  of  the  centerline  camera  application. 

With  sbe  fixed,  we  have  chosen  the  CCD  technology  (back-illuminated,  thinned,  buried  transfer  anti¬ 
blooming  gates).  This  technology  offers  high  sensitivity,  low  noise,  wide  dynamic  range,  and 
extremely  effective  anti-blooming  protection.  It  thus  addresses  all  the  important  performance  areas 
discassed  previously. 

Vl-a.  Custom  CCD  Sensor 

David  Samoff  Research  Center  (DSRC,  previously  RCA’s  Samoff  Laboratory)  has  been  at  the 
forefront  of  CCD  development  from  the  beginning.  DSRC’s  fabrication  technology,  and  their 
business  interest  in  high-performance  military  and  aerospace  sensor  fabrication  make  them  an 
attractive  candidate  for  manufacturing  the  proposed  sensors.  As  a  particular  strength  for  the 
centerline  camera  application,  DSRC  has  a  proprietary  technique  for  achieving  an  extremely  high  level 
of  antiblooming  capability.  Their  “buried  channel”  devices  have  an  overload  capacity  of  >50,000 
times  the  full-well  saturation  signal  levels.  Combined  with  the  wide  dynamic  range  of  the  propo.sed 
sensor,  the  DSRC  CCD  can  provide  virtually  complete  protection  against  charge-spreading  blooming 
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effects  in  the  detector. 


The  following  paragraphs  describe  the  proposed  sensor  technology.  Table  1  summarizes  the 
propo.sed  design  parameters  and  expected  peifonnance  levels.  It  should  be  stressed  that  all  of  the 
CCD  technology  assumed  in  this  design  has  been  proven.  The  proposal  is  merely  to  apply  existing 
technology  to  a  design  optimized  for  the  ILARTS  centerline  camera  operation. 

It  is  important  to  note  that  this  large  area,  low  noise,  high  quantum  efficiency  CCD  and  a 
system  employing  this  low  light,  wide  dynamic  range  camera  will  find  a  number  of  military 
and  industrial  applications.  This  will  insure  the  “commercial  success,”  which  has  become  an 
important  aspect  of  the  SBIR  program. 


Approach 

The  proposed  imager  is  based  on  Samoff  s  back  illuminated  CCD  technology  incorporating  three 
level  polysilicon  gates,  buried  blooming  drains,  and  whole  wafer  thinning.  These  technologies  have 
been  in  successful  production  for  more  than  10  years.  Back  illumination  offers  100  percent  optical 
fill  factor  (no  blind  areas  within  the  pixel)  and  high  quantum  efficiency  over  the  visible  and  near  IR 
spectrum.  Back  illumination  also  provides  a  lower  level  of  optical  flare  than  top  illuminated  imagers 
having  repetitive  structure  capable  of  scattering  light. 

Buried  drain  blooming  control,  invented  at  Samoff,  is  capable  of  containing  optical  overloads  greater 
than  50,000  times  while  not  significantly  reducing  imager  sensitivity. 


Back  Bluminated  Structure 

Fipre  8  is  a  cross-sectional  view  of  Samoff  s  back-illuminated  structure.  The  silicon-substrate 
thinning  process  is  carried  out  on  the  entire  4-inch  diameter  wafer  after  all  high  temperature 
fabrication  steps  are  completed.  Thinning  is  stopped  when  the  desired  substrate  thickness  of 
approximately  12  pm  is  reached.  Whole- wafer  thinning  versus  single  device  thinning  gives  lower  cost 
per  device.  When  thinning  is  complete,  the  back  surface  of  the  wafer  is  ion  implanted  to  give  a  thin, 
low-resistivity  p+  layer.  The  implanted  p-i-  layer  is  than  furnace  annealed.  This  results  in  high 
quantum  efficiency  across  the  visible  spectrum.  Quantum  efficiency  is  more  uniform  across  the 
imager  using  furnace  anneal  than  can  be  achieved  by  other  methods.  Laser  anneal,  for  example, 
which  heats  the  implanted  back  surface  with  a  scanned  laser,  produces  streaks  of  varying  sensitivity. 
This  results  in  a  non-uniform  displayed  image. 

After  back-surface  anneal,  a  transparent  glass  substrate  is  laminated  with  a  transparent  adhesive  to 
the  optical  input  side  of  the  thinned  wafer  to  provide  mechanical  support.  After  lamination,  metal 
definition  is  completed.  There  are  no  high  temperature  steps  in  the  process  after  the  metal  deposition, 
allowing  the  use  of  low  resistivity  aluminum  bus  connections  on  the  imager.  This  allows  higher  clock 
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rates  and  larger  image  formats  than  are  possible  with  a  retVactory  metal  bus  process. 


Imager  Architecture 

The  proposed  frame  transfer  imager  architecture  is  shown  in  Figure  9.  The  illuminated  A-register  is 
used  for  image  detection  and  transfer  of  charge  to  the  B-register  during  the  vertical  blanking  pericxi. 
The  B-register  is  shielded  from  light  and  used  for  temporary  field  storage  during  readout.  The  C- 
register  is  the  horizontal  readout  register  which  reads  one  line  at  a  time  from  the  image  field  stored 
in  the  B-register.  The  signal  is  sensed  by  a  floating  diffusion  electrometer  stage  followed  by  an  on- 
chip  buffer  amplifier  having  a  readout  noise  floor  of  <  25  mis  electrons/pixel. 

The  nominally  22.5  mm  diagonal  A-register  has  a  3:4  aspect  ratio  with  488  lines  of  vertical  resolution. 
The  lines  are  read  out  in  two,  interlaced  fields  to  match  RS-170  video.  The  interlace  imager  is  chosen 
because  progressive  scan  at  the  imager  and  interlace  at  the  display  would  result  in  undesirable  motion 
artifacts.  This  design  choice  is  based  on  the  present  landing  system  display.  If  at  a  future  time  the 
display  is  required  to  operate  in  the  progressive  scan  mode  the  imager  design  could  be  modified  to 
operate  with  progressive  scan  readout. 

The  imager  will  have  between  600  and  1000  horizontal  elements.  The  exact  number  of  pixels  will 
be  chosen  based  on  the  tradeoff  between  resolution  and  sensitivity.  The  A  and  B  registers  each  have 
244  CCD  stages.  The  center  of  the  vertical  pixel  is  moved  vertically  by  one  half  pixel  height  on 
alternate  odd  and  even  fields.  This  Is  accomplished  by  changing  the  voltage  applied  to  the  A-register 
transfer  gates  on  alternate  fields.  This  serves  to  move  the  pixel  centroid  on  alternate  fields  to  produce 
2: 1  imager  interlace. 

The  output  amplifier  will  use  a  floating  diffusion  stage  with  on-chip  buffer  amplifier.  The  floating 
diffusion  capacitance  and  buffer  transistor  noise  floor  with  be  optimized  to  give  readout  noise  for  a 
dark  field  <  25  rms  electrons 


Blooming  Control 

The  buried  blooming  drain  structure  is  a  unique  Samoff  design  capable  of  containing  extremely  high 
optical  overloads  without  image  blooming  while  at  the  same  time  causing  very  little  loss  of  desired 
signal  ch^ge.  Blooming  drains  which  not  use  the  buried  approach  remove  a  significant  amount  of 
desired  signal  charge,  as  well  as  the  unwanted  overload  charge.  They  thus  reduce  low  light  level 
sensitivity. 

A  cross-sectional  view  and  channel-potential  diagram  for  the  buried  anti-blooming  drain  structure  is 
Ulustrated  in  Figure  10.  The  excess  charge  is  removed  via  an  N+  anti-blooming  drain  that  mns 
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parallel  to  the  vertical  CCD  transfer  channels.  The  N-  channel  stop  barrier  sets  the  barrier  potential 
on  either  side  of  the  anti-blooming  drain  so  that  excess  charge  spills  preferentially  across  the  channel 
stop  to  the  blooming  drain  rather  than  spreading  up  and  down  the  CCD  channel.  Tlie  N+  blooming 
drain  region  is  connected  to  an  external  bias  voltage.  To  reduce  loss  of  signal  to  the  blooming  drain,s\ 
a  P-type  region  is  implanted  under  the  blooming  drains  and  barriers.  This  buried  region  reduces  the 
size  of  the  depleted  region  resulting  from  the  reverse-biased  drains,  and  therefore  reduces  the 
probability  of  losing  useful  signal  charge. 

Figure  1 1  is  a  plot  showing  the  fraction  of  signal  charge  collected  by  the  blooming  drain  as  function 
of  wavelength.  This  characteristic  was  measured,  for  a  12  pm  thick  substrate,  by  comparing  the 
reset  drain  signal  current  with  the  blooming  drain  as  a  function  of  wavelength  for  uniform 
illumination.  As  can  be  seen,  over  the  visible  spectrum,  the  shield  keeps  the  blooming  drain  loss  to 
less  than  4.5  percent. 


Quantum  EfHciency 

Figure  12  is  a  plot  of  quantum  efficiency  versus  wavelength  measured  for  a  Sarnoff,  thinned  back 
illuminated  512  x  512  CCD  array  with  and  without  anti  reflective  coatings.  Quantum  efficiency  can 
be  fuither  improved  by  the  addition  of  antireflective  coating  to  the  air-glass  interface  as  well  as  to  the 
silicon-lamination-adhesive  interface.  It  is  also  possible  to  increase  response  for  wavelengths  longer 
than  700  nm  by  increasing  the  thickness  of  the  thinned  substi-ate. 

Vl-b.  Camera  Optics 

The  ERIM  study  of  the  ILARTS  mission  and  the  laboratory  experiments  carried  out  in  this  Phase 
I  study  emphasize  the  problems  related  to  trying  to  see  the  wheels  and  underside  of  aircraft  as  they 
approach  the  aircraft  carrier  for  a  landing.  As  is  shown  in  Figure  2,  laboratory  experiments  have 
verified  that  flare  in  the  optics  is  the  dominant  source  of  the  halo  “wings”  around  bright  point  sources 
in  the  field  of  view  of  a  CCD-based  camera  with  good  anti-blooming  capability.  The  flare  in  even  a 
high-quality  commercial  lens  is  made  intolerable  in  the  ILARTS  situation  by  the  bright  lights 
appearing  near  the  dimly  illuminated  region  of  interest,  the  undercarriage  of  the  aircraft.  The  problem 
is  analogous  to  trying  to  make  out  the  details  of  an  oncoming  vehicle  in  spite  of  the  glare/flare  of  its 
headlights. 

Given  the  importance  of  the  lens  and  other  optical  elements  in  the  performance  of  the  camera  under 
ILARTS  viewing  conditions,  it  is  important  that  the  Phase  11  work  statement  include  the  design  and 
fabrication  of  an  optically  fast  lens  with  flare  reduction  as  a  primary  design  criterion.  It  should  also 
be  noted  that  the  elimination  of  the  relay  lens  currently  employed  in  ILARTS  will  also  reduce  the 
optical  flare. 

Our  optical  consultant,  prior  to  retirement,  was  the  chief  optical  designer  for  Perkin  Elmer”s 
California  Division.  He  has  made  several  suggestions  regarding  the  optical  design  approach  and 
manufacturing  processes  that  will  minimize  flare.  Recently  we  found  a  star  tracker  lens  that  employs 
the  same  low  flare  optical  design  our  consultant  recommended.  Preliminary  test  of  this  lens  show 
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a  factor  of  at  least  5  less  flare  than  the  best  commercial  lens  we  have  used  in  the  Phase  I  laboratory 
experiments.  This  is  very  encouraging  and  leads  to  the  optimism  that  a  custom  designed  lens  can 
reduce  the  flare  by  at  least  an  order  of  magnitude  over  what  has  been  employed  in  the  past. 

From  the  manufacturing  standpoint  it  is  important  to  coat  the  lenses  with  anti-reflection  coatings  that 
are  effective  over  the  spectral  band  where  the  illumination  and  image  sensor  overlap.  Referring  back 
to  Rgure  6,  this  band  extends  from  the  blue  into  the  near  TR.  Most  commercial  lens  are  not  coated 
with  the  near  IR  in  mind  because  of  the  visible  spectral  band  is  the  primary  interest.  It  is  also 
important  to  move  the  edges  of  the  optical  elements  out  of  the  beam  of  light  so  as  to  eliminate  light 
scattering  from  these  surfaces.  Aperture  stops  should  be  as  tliin  as  possible  for  the  same  reason. 
Finally,  one  wants  to  minimi7e  the  number  of  lens  elements  and  glass  to  air  surfaces  in  the  optical 
design. 

One  option  for  innovative  low-flare  lens  design  is  the  so-called  “monocentric”  lens  design.  In  these 
lenses,  all  surfaces  are  spherical,  and  the  centers  of  curvature  of  all  the  surfaces  lie  at  the  same  point 
in  space.  Essentially,  the  lens  becomes  a  multi-layer  crystal  ball  structure.  In  simplistic  terms,  it  has 
a  2n  radian  FOV,  since  it  images  equally  from  all  directions.  Ghost  images  are  well  controlled,  and 
there  are  minimal  problems  with  diffraction  from  defining  apertures.  The  design,  however,  necessarily 
implies  a  curved  focal  plane  which  may  not  be  tolerable.  We  are  exploring  both  the  monocentric 
concept  and  modifications  which  might  be,better  options  for  our  application. 

VI-c.  Signal  Processing 

As  was  discussed  previously,  we  envisage  using  an  analog  non-linear  signal  compression  stage  early 
in  the  signal  processing  sequence,  to  make  optimum  use  of  the  signal-to-noise  ratio  in  the  amplitude 
range  available,  and  to  allow  digitization  at  video  rates  usin?  an  acceptable  number  of  bits  in  the 
ADC. 

Flexible,  programmable,  digital  signal  processing  would  be  used  to  allow  exceptionally  wide-range 
control  of  the  usual  parameters  of  brightness,  contrast,  and  gamma  to  provide  the  Landing  Signal 
Officer  the  best  possible  visual  access  to  the  wide  dynamic  range  of  the  image  acquired  by  the  CCD. 
This  control  could  be  exercised  manually,  or  under  partial  or  full  electronic  control.  (It  is  likely  that 
automatic  control  would  be  used  for  certain  of  the  crudest  parameters  —  gain  and  iris  setting,  for 
example  —  but  a  more  flexible  approach  to  such  techniques  as  histogram-based  signal  processing  is 
required  in  order  to  provide  the  ability  to  optimize  the  system  based  on  future  field  experience.) 

Certain  other  aspects  of  the  proposed  electronics  are  discussed  in  the  following  section,  on 
Configuration.  These  include  RS170  output,  vs  future  higher-definition,  conceivable  digital  outputs. 
The  basic  camera  concept  proposed  could,  of  course,  support  any  such  future  options. 

Vl-d.  Configuration 

Figure  13  is  a  configuration  drawing  showing  the  proposed  Centerline  Camera  in  position  below 
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the  existing  folding  miiTor.  In  addition  to  the  miiror,  the  rotating  shutter  (required  for  frame  transfer 
CCD’s  when  used  with  bright  sources),  the  single  lens  assembly,  the  CCD,  and  the  electi-onics 
compartment  are  all  indicated.  The  assembly  is  simple  and  compact.  No  relay  len.ses  are  required  to 
fit  into  the  available  space.  The  camera  electronics  will  be  packaged  along  with  the  lens  and  CCD 
sensor  in  a  single  housing  that  will  be  considerably  smaller  than  the  existing  SIT-tube  camera. 

The  CCD  detector  will  be  mounted  on  a  simple  thermoelectric  cooler  operating  at  a  modest  AT  to 
keep  the  dark  current  low  enough  that  the  dark  current  shot  noise  will  not  degrade  the  camera  signal 
to  noise  ratio.  The  CCD  portion  of  the  camera  housing  will  be  hermetically  sealed  to  eliminate 
condensation  that  might  otherwise  form  on  the  cooled  surfaces.  Heat  from  the  thermoelectric  hot 
junction  can  be  removed  simply  by  convection.  The  CCD  camera  should  require  no  maintenance 
except  for  periodic  cleaning  of  the  window. 


Figure  14  is  a  block  diagram  of  the  camera.  Adjustments  of  the  camera  gain,  Uansfer  function  and 
iris  will  be  made  via  remote  control  from  the  LSO  Hutch  or  controlled  automatically  by  the  camera’s 
signal  processing  system.  The  existing  ILARTS  centerline  camera  generates  a  standard  RS- 170 
analog  video  signal  Based  on  past  experience  with  the  Image  Isocon  television  cameras,  the  spatial 
resolution  afforded  by  the  broadcast  standards  for  monochrome  television  are  adequate  for  the 
ILARTS  mission.  These  are: 

60  interlaced  fields/sec, 

256  lines  per  field. 

Horizontal  Resolution  320  lines 

4  MHZ  video  bandwidth. 

It  would  be  possible  in  designing  the  CCD  and  the  camera  electronics  to  incorporate  more  pixels 
in  the  CCD  horizontal  lines  than  would  be  necessary  to  fiilly  exploit  the  4  MHZ  bandwidth.  This 
would  allow  higher  horizontal  resolution  to  be  an  option  of  the  user,  by  increasing  the  bandwidth 
of  the  video  signal  exiting  the  camera.  This  option  could  be  exercised  when  there  is  sufficient 
illumination  that  the  added  noise  associated  with  wider  bandwidth  will  not  significantly  degrade 
the  videoimage. 

It  also  seems  prudent  to  design  into  the  engineering  test  cameras  that  will  be  built  and  evaluated 
in  Phase  n,  a  digital  video  output  as  well  as  the  RS-170  analog  output.  This  digital  output  will 
be  available  for  experiments  involving  digital  transmission  of  video  from  the  cameras  to  the 
display  monitors. 

There  is  considerable  effort  within  the  broadcast  television  industry  to  develop  what  is  called 
“High  Definition  Television  “  which  will  have  at  least  twice  the  spatial  resolution  of  current 
broadcast  television.  The  standards  being  developed  for  High  Definition  TV  will,  it  appears, 
involve  digital  transmission  of  the  television  signal  and  some  form  of  bandwidth  compression 
based  on  less  frequent  updating  of  area  of  the  image  that  are  not  changing.  This  will  involve 
sophisticated  image  processing  within  the  television  receiver.  It  does  not  appear,  based  on  the 
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Phase  1  study  and  laboratory  simulations  of  the  ILARTS  centerline  camera  situation,  that  high 
resolution  is  a  significant  advantage.  Certainly,  sensitivity  should  not  be  reduced  to  gain  higher 
spatial  resolution. 

Vl-e.  Possible  Extensions  to  System 

The  basic  CCD  technology  described  above  can  provide  an  extremely  effective  centerline  cameras 
system.  It  offers  superb  low-light-level  performance,  with  low  noise,  exceptionally  wide  dynamic 
range,  and  flare  and  blooming.  With  the  signal  processing  technicjiies  which  can  be  applied,  it  will 
pre.sent  a  drastically  improved  image  to  the  LSO  aboard  ship. 

Future  evolutions  may  be  made  in  the  area  of  signal  processing,  based  on  experience  and, 
perhaps,  on  advances  in  available  processing  power.  One  additional  possibility  might  be  di,scu.ssed 
as  the  proposed  effort  advances  -  that  is  the  potential  value  of  color  CCD  imagery.  At  night,  it 
is  probably  best  to  use  all  of  the  available  photons  in  the  image  of  the  undercaniage  to  present 
a  low  noise,  high  contrast  monochrome  image.  During  the  day,  however,  a  similar  large-area 
color  CCD  chip  might  be  used  together  with  a  color  monitor.  The  second  chip  might  work 
through  the  same  lens  as  the  first,  and  could  be  behind  a  beam  splitter  which  “steals”  perhaps  10% 
of  the  available  light.  It  could  then  be  u.sed  in  the  day,  when  photon  numbers  do  not  limit  .sy.stem 
performance.  Further,  at  night,  it  might  be  able,  with  intelligent  processing,  to  track  the  positions 
of  the  navigation  and  other  lights  on  an  approaching  aircraft.  Intelligent  image  processing  on 
these  positions  could  yield  infoimation  on  position  and  attitude,  rates  of  change  and  extrapolated 
values  for  position  and  attitude  coordinates,  and  even  on  the  color  of  attitude-indicating  lights  on 
the  plane. 


Tbe  potential  value  of  adding  a  second,  color,  camera  to  the  centerline  system  would  have  to  be 
discussed  in  detail  before  making  a  decision  on  the  idea.  However,  the  fundamental  simplicity 
of  CCD  sensors,  and  the  low  level  of  complexity  of  support  electronics,  make  such  a  concept 
-relatively  easy  to  implement  if  the  value  should  be  agreed. 

Vl-f.  Cost  Considerations 


In  the  broadest  terms,  the  relatively  simple  sensor  and  support  implied  by  the  use  of  CCD 
technology  implies  low  systems  cost,  low  support  cost,  and  easy  maintenance  of  a  CCD-based 
ILARTS  system.  Although  this  report  recommends  development  of  custom  realizations  of 
sensor,  optics,  and  electronics  system  elements,  the  basic  simplicity  of  the  technology  is  still 
present,  with  the  implied  low  cost 

The  most  fundamental  premises  of  this  Report  are: 

(1)  the  performance  level  of  any  new  centerline  camera  technology  should  not  be  limited  by  a 
requirement  to  use  off-the-shelf  components.  In  particular,  the  importance  of  acceptance  aperture 
to  photon-statistical  limits  on  system  signal-to-noise  ratios  argues  that  sensor  selection  should  not 
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be  limited  to  the  available  technologies  or,  most  importantly,  to  available  sizes;  and 

(2)  the  performance  of  an  optimized  CCD-based  centerline  camera  system  can  meet  all  system 
requirements,  and  greatly  exceed  the  petformance  of  all  past  (Isocon  or  SlT-based)  systems. 

These  assumptions  justify  the  propo.sal  to  base  a  new  system  on  a  custom-designed  suite  of  back- 
illuminated  CCD  sensor,  optics,  and  elecuonics. 

The  proposed  large-area  back-illuminated  CCD  chip  would  repre.sent  an  advance  in  the  state  of 
the  art  of  available  CCD  .sensors  for  general  low  light  level  applications.  As  a  result,  it  would 
have  more  general  application  within  the  military,  and  also  strong  commercialization  potential  in 
the  spirit  of  SBIR  funding  programs.  Both  of  these  considerations  could  be  lused  to  justify 
considering  the  finding  of  chip  development  costs  from  a  broader  perspective  than  just  the 
ELARTS  program  needs.  In  any  ca.se,  the  number  of  ILARTS  cameras  which  will  ultimately  be 
deployed  on  Navy  ships  is  sufficient  to  justify  the  development  costs. 

It  is  important  to  note  that  this  large  area,  low  noise,  high  quantum  e^ciency  CCD  and 
a  sptem  employing  this  low  light,  wide  dynamic  range  camera  will  find  a  number  of 
military  and  industrial  applications.  This  will  insure  the  “commercial  success,”  which  has 
become  an  important  aspect  of  the  SBIR  program. 


Relative  Cost  of  PSI  CCD  camera  system  and  FLIR  Systems 
Dual  Sensor/Image  Fusion  camera  system 

There  is  little  argument  that  a  television  camera  employing  a  single  back  illuminated  CCD  is 
fundamentally  less  complicated  and  less  expensive  to  manufacture  and  maintain  compared  to  a 
dual-sensor-fused-image  camera  system  made  up  of  two  cameras,  one  employing  a  back 
illuminated  CCD  and  the  other  a  cryogenically  cooled  infrared  focal  plane  array. 


First  of  all  there  is  the  cost  of  the  IR  camera.  The  combining/fusing  of  these  two  video  images, 
each  having  a  different  number  of  pixels  per  line  and  lines  per  raster,  into  a  composite  image 
requires  considerable  high  speed  digital  electronics.  And  the  cryogenic  cooling  required  for  the 
infrared  detector  has  a  finite  life  and  will  require  servicing  and  periodic  replacement.  CCD 
cameras  contain  no  components  or  subsystems  with  limited  life  and  require  only  routine 
maintenance  other  than  occasional  cleaning  of  the  optical  window  in  the  deck. 

While  the  development  cost  of  the  FLIR  Systems  dual  sensor/image  camera  is  being 
underwritten  by  their  contract  with  DARPA  for  an  airborne  system,  one  must  consider  the 
production  and  maintenance  cost  of  the  more  than  100  cameras  that  the  Navy  plans  to  purchase 
under  the  VISION  program.  One  can  expect  the  more  complicated  dual  sensor/image  fusion 
camera  systems  to  cost  3  to  4  times  the  cost  of  the  single  CCD  camera  described  in  this  Phase 
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I  study.  And  the  maintenance  and  logistic  expense  makes  the  total  difference  in  program  cost 
even  greater.  Cost  is  important  from  the  SBIR  commercialization  viewpoint  as  well. 


Given  this  very  large  difference  in  the  fundamental  cost  of  the  two  approaches,  the  much  higher 
cost  of  a  dual  sensor  camera  system  can  only  be  justified  if  the  mid-infrared  band  sensitivity  is 
required  to  fulfill  the  centerline  camera  job.  Given  that  the  Image  Isocon  cameras,  which 
performed  acceptably  as  centerline  cameras,  were  not  even  very  sensitive  in  the  red,  much  less 
the  mid-IR,  there  appears  to  be  no  real  need  for  infrared  imaging  in  order  to  perform  the  VISION 
centerline  camera  job.  And  it  is  the  conclusion  of  this  Phase  1  study  that  a  camera  based  on  a 
back  illuminated  CCD  can  match  and  in  under  most  illumination  conditions  exceed  the 
performance  of  the  Image  Isocon  in  this  application. 
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■TABLE  I. — Wide  Dynamic  Ran^e  fmager 


Specification 

Imager  Architecture 

Imager  Format 
interlaced) 

Readout/Scan 

Pixel  Size 

Image  Diagonal 

Optical  Fill  Factor 

Overload  Capability  ‘ 

Readout  Amplifier  Noise 

Saturation  Level  ^ 

Dynamic  Range 

Horizontal  MTF  ^ 


Nominal  Parameters 
Frame  Transfer 
640  (H)  X  488  (V- 

2:1  Vertical  Interlace 
28  pm  (H)  X  56  pm  (V) 
22.5  mm 
100% 

>  50,000  X 

<  25  Elec.  RMS/Pixel 

>  1,000,000  electrons 
>91dB  (35,000:1) 
>58% 


‘  With  shutter  to  eliminate  vertical  transfer  smear. 

^  Linear  to  150,000  e,  then  compressed  gain  to  10*  e. 

^  Broad-band  (400  - 1,000  nm,  assumed  flat  spectrum)  at  Nyquist  sampling  limit 
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Figure  1.  Internal  Structure  of  Typical  SIT  Tube. 
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Relative  intensities 


"Landing  Light"  -  CCD  and  UDT  Detector  Signal  Levels  vs  Position, 
28  mm  f/2.8  lens  (combined  data  for  0.5  and  0.1  mm  UDT  photodiode 
apertures,  scaled  to  area) 


10" 

10^ 

10^ 

10^ 

10° 
lO’"' 

10'^ 

Figure  2.  Measurements  of  Image  Spreading.  These  data  show  that 
the  image  spreading  is  optical,  and  not  due  to  CCD  blooming. 
Note:  1  mm  corresponds  to  15%  of  the  horizontal  field  of 
view  of  the  4.84  x  6.45  mm  CCD  detector. 
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Back-Illuminated  CCD 


S-20  Semitransparent  Photocathode 


ILLUMINATION;  2054- K  INCANDESCENT 
FACEPLATE  ILLUMINATION  ADJUSTED  TO  OPERATE 
TUBE  WITH  highlights  ONE  STOP  OVER  THE 
KNEE  OF  light  transfer  CHARACTERISTIC 
F  SYSTEM  ■  42  MHr 


Figure  4.  Signal-to-Noise  Ratio  of  Image  Lsocon 
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Relative  Intensity 

(watts  per  unit  area  per  unit  wavelength 


1.2 


Wavelength,  nm 

NavyL03 


Figure  5.  Relative  Spectral  Intensities  of  Moonlight  and  Starlight 
Illumination.  Each  curve  has  been  normalized  to  unity 
at  its  peak. 
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Figure  6.  Relative  Responses  of  CCD  and  S-20  Sensors 
Moonlight  and  in  Starlight.  (The  products  of  the 
curves  of  Figures  3  and  5.) 


Signal-to-Noise  Ratio 


t. 


Figure  7.  Signal-to-Noise  Ratios  of  CCD  and  Image  Isocon 
Detectors. 
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Figure  8.  Cross-section  of  DSRC  Back-TIIuminated  CCD  Detector  Technology. 
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Figure  9.  Architecture  of  Frame  Transfer  CCD  Imager. 
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CHANNEL  POTENTIAL 
'' - -  UNDER  BARRIER  GATE 


Figure  10.  Cross-Section  of  Buried  Anti-Blooming  Drain  Structure. 
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Blooming  Drain  Current/Signal  Current 
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Figure  11.  Ratio  of  Blooming  Drain  Cuirent  to  Signal  Current, 
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Folding  Mirror 
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Figure  1 3.  Configuration  Sketch.  Conceptual  layout  of  proposed  ILARTS 
CCD  centerline  camera. 
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Folding  Mirror 


Deck  Window 


Remote-controlled 

Iris 


Low-flare  Lens 


Rotating  Shutter 


Back-Illuminated  CCD 
Image  Sensor 


Figure  14.  Block  Diagram  of  CCD  Camera. 
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